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CLAIMS 

1 . A method of generating panoramic images from a motion-compensated inter- 
frame encoded video sequence, the method comprising: 

5 positioning the image of each frame of the sequence on a panoramic image 

reference plane, such that the respective images of each frame are in registration with 
each other, and one or more pixel values are available for each pixel position in the 
reference plane; and 

for each pixel position in the reference plane, selecting one of the available pixel 
10 values for use as the pixel value in the panoramic image; 

the method being characterised in that the selecting step further comprises 
selecting a substantially median pixel value from the available pixel values for use in a 
background panoramic image and/or selecting a substantially most different pixel value 
from the available pixel values for use in a foreground panoramic image. 

15 

2. A method according to claim 1 , wherein the positioning step further comprises: 
determining global motion estimations for each frame in the sequence; 
selecting a particular frame of the sequence as a reference frame, the plane of 

the reference frame being the panoramic image reference plane; 
20 for each frame other than the reference frame, accumulating the global motion 

estimations from each frame back to the reference frame; and 

warping each frame other than the reference frame onto the reference plane 
using the accumulated global motion estimations to give one or more pixel values for 
each pixel position in the reference plane. 

25 

3. A method according to any of claims 1 or 2, wherein the selecting step further 
comprises: 

calculating the mean pixel value of the available pixel values; 

calculating the L1 distance between each available pixel value and the 
30 calculated mean pixel value; and 

selecting the pixel value with the median L1 distance for use in a background 
panoramic image; and/or 

selecting the pixel value with the maximum L1 distance for use in a foreground 
panoramic image. 
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4. A computer program or suite of programs arranged such that when executed on 
a computer system the program or suite of programs causes the computer system to 
perform the method of any one of the preceding claims. 

5 5. A computer readable storage medium storing a computer program or suite of 
programs according to claim 4. 

6. A system for generating panoramic images from a motion-compensated inter- 
frame encoded video sequence, comprising: 

10 image registration means for positioning the image of each frame of the 

sequence on a panoramic image reference plane, such that the respective images of 
each frame are in registration with each other, and one or more pixel values are available 
for each pixel position in the reference plane; and 

pixel selection means arranged in use, for each pixel position in the reference 

15 plane, to select one of the available pixel values for use as the pixel value in the 
panoramic image; 

the system being characterised in that the pixel selection means further 
comprises background pixel selection means for selecting a substantially median pixel 
value from the available pixel values for use in a background panoramic image and/or 
20 foreground pixel selection means for selecting a substantially most different pixel value 
from the available pixel values for use in a foreground panoramic image. 

7. A system according to claim 6, wherein the image registration means further 
comprises: 

25 motion estimator means for determining global motion estimations for each 

frame in the sequence; 

frame selector means for selecting a particular frame of the sequence as a 
reference frame, the plane of the reference frame being the panoramic image reference 
plane; 

30 motion estimation accumulator means for, for each frame other than the 

reference frame, accumulating the global motion estimations from each frame back to the 
reference frame; and 

frame warping means for warping each frame other than the reference frame 
onto the reference plane using the accumulated global motion estimations to give one or 

35 more pixel values for each pixel position in the reference plane. 
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8. A system according to any of claims 6 or 7, wherein the background pixel 
selection means further comprises: 

calculator means arranged in use to: 
5 calculate the mean pixel value of the available pixel values; and 

calculate the L1 distance between each available pixel value and the 
calculated mean pixel value; and 

a median pixel selector arranged to select the pixel value with the median 
L1 distance for use in a background panoramic image 

10 

9. A system according to any of claims 6 to 8, wherein the foreground pixel 
selection means further comprises: 

calculator means arranged in use to: 

calculate the mean pixel value of the available pixel values; and 
15 calculate the L1 distance between each available pixel value and the 

calculated mean pixel value; and 

a maximum pixel selector arranged to select the pixel value with the 
maximum L1 distance for use in a foreground panoramic image. 



